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Abstract 

In this note we show that unsatisfiable systems of linear equations with a con¬ 
stant number of variables per equation over prime finite fields have polynomial-size 
constant-degree semi-algebraic proofs of unsatisfiability. These are proofs that manip¬ 
ulate polynomial inequalities over the reals with variables ranging in {0,1}. This upper 
bound is to be put in contrast with the known fact that, for certain explicit systems of 
linear equations over the two-element field, such refutations require linear degree and 
exponential size if they are restricted to so-called static semi-algebraic proofs, and even 
tree-like semi-algebraic and sums-of-squares proofs. Our upper bound is a more or less 
direct translation of an argument due to Grigoriev, Hirsch and Pasechnik (Moscow 
Mathematical Journal, 2002) who did it for a family of linear systems of interest in 
propositional proof complexity. We point out that their method is more general and 
can be thought of as simulating Gaussian elimination. 


1 Semi-algebraic proofs 

The proof system we consider is inspired by the Sherali-Adams and Lovasz-Schrijver lift- 
and-project methods for combinatorial optimization Em, seen as proof systems for deriving 
polynomial inequalities (see also |6l |3l E]). In addition to the axioms 

Xi > 0 1 — > 0 x^ — Xi > 0 Xi — xj > 0 

for formal variables xi,..., it has the following inference rules: 

F(x) > 0 Q(x) > 0 P(x) > 0 P(x) > 0 

a ■ P(x) -I- b ■ C(x) > 0 -P(x) ■ Xi > 0 -P(x) ■ (1 “ — 0 

where P(x) and Q(x) are polynomials with rational coefficients and variables within x = 
(xi,, Xn), and a and b are non-negative rational numbers. The hrst rule is called positive 
linear combination and the second and third rules are called multiplication or lifting rules. 
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It follows from |1] that if a system of linear inequalities over the reals in n variables does 
not have any solution in {0,1}”, then the trivial contradiction —1 > 0 can be derived from 
the given inequalities, even if all polynomials are restricted to total degree two. In general, 
the length of such a proof could be exponential in a polynomial in n, but the shortest such 
proof is never worse than that. Here, by length we mean the number of derived inequalities. 
This and other complexity measures for proofs are dehned next. 

The degree of a proof is the maximum of the total degrees of the polynomials that appear 
in it. The length of a proof is the number of inferences. The size of a proof is the sum of 
the sizes of the polynomials that appear in it, where the size of a polynomial is the sum 
of the degrees of its monomials. A proof is tree-like if every derived inequality is used at 
most once as the hypothesis of another rule, i.e. the shape of the proof is a tree, with the 
hypotheses and the axioms at the leaves and the conclusion at the root. A refutation is 
a proof of —1 > 0. When we write an inequality H(x) > Q(x) what we really mean is 
F(x) — Q(x) > 0. Similarly, when we write an equation P(x) = Q(x) what we really mean 
is the set of the two inequalities F(x) — Q(x) > 0 and Q(x) — P(x) > 0. 

2 Some facts about semi-algebraic proofs 

For every linear form L(x) = 'Y^=i with rational coefficients and every integer c, let 
Dc{L{x)) be the quadratic polynomial (T(x) — c) • (L(x) — c + 1). In words, the inequality 
Dc{L{x)) > 0 states that L{x) does not fall in the open interval (c — 1, c). Such statements 
have short proofs of low degree: 

Lemma 1 (Grigoriev, Hirsch, and Pasechnik |3]). For every integer c and for every linear 
form L(x) = Ym=i with integer coefficients Oi,..., the ineguality Dc{L(x)) > 0 has 
a tree-like proof of length polynomial in max{|ai| : i = 1,..., n} and n, and degree at most 3. 

The next lemma states that polynomial equalities can be freely substituted. A similar 
statement appears in [3] [Lemma 5.2]; our statement is slightly stronger. 

Lemma 2. Let P{x), Q{x), and R{x,y) be polynomials with variables as indicated, and let 
d be the degree of y in R(x,y). The eguation R{x,P{x)) = R{x,Q{x)) has a proof from 
P{x) = Q(x) of length bounded by a degree-d polynomial in the sizes of P(x), Q(x) and 
R{x,y), and degree at most linear in the degree of R(x,y) and d times the degrees of P{x) 
and Q(x). 

Proof. It suffices to prove the statement when F(x, y) is linear in y, the general statement 
in which y has degree d > 1 in F(x, y) follows from iterating the lemma on the polynomial 
R!{x, yi,... ,yd) obtained from R{x, y) by replacing each y^ by ni=i Vi- Write every monomial 
in R{x,y) in the form y ■ M(x), where M{x) is a monomial without y. The equality P{x) ■ 
M(x) = Q{x) ■ M(x) follows at once from P{x) = Q(x) by the multiplication rule. Adding 
up over all monomials of R{x,y) we get the result. To see the bound on the size note that, 
in case R{x,y) is linear in y, the size of F(x, P(x)) is bounded by the product of the sizes 
of R{x,y) and P{x), and similarly for R{x,Q{x)). Iterating d times to handle the general 
d > 1 case we get the degree-d polynomial bound on the length of the proof. □ 
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3 Two-element field 


We identify the elements of the two-element held F 2 with {0,1}. Let x = (xi,..., x„) be 
formal variables ranging over F 2 or Q, depending on the context. For every linear equation 
of the form a"'"x = b, where a G F 2 and 6 G F 2 , let iS(a, b) be the system of linear inequalities 

^( 1 -Xi)+ Xj > 1 for all T C / such that \T\ = 1 — b mod 2, 

ieT ieI\T 

where / = supp(a) := {i G [n] : a* 7 ^ 0} and [n] := {1,..., n}. Note that iS(a, b) has exactly 
2 hl-i inequalities, and that it is satished in Q by a { 0 , l}-assignment to the x-variables if 
and only if a"'"x = 6 is satished in F 2 by the same assignment. For a system of m linear 

equations Ax = b as above, let iS(A,b) := a* ranges over the rows of A 

and bi ranges over the components of b. Note that this system has at most m2"’ inequalities, 
where w is the maximum number of non-zero components in the rows of A. 

For an equation of the form a"'"x = b as above, an alternative way of writing the system 
iS(a, b) is by imposing the system of polynomial equalities 

n^‘ n (1 — Xj) = 0 for all r C / such that |r| = 1 — 6 mod 2 . 

ieT i(ei\T 

In the following, for I C [n] and T let ALf (^) •— riiGT XilljeAT’^^ — Xi). Such 

polynomials are called extended monomials. We start by noting that 

^My(x) = JJ(xi + 1 - Xi) = 1 . ( 1 ) 

TCI id 

We continue relating the two forms of expressing the equation a"'"x = b: 

Lemma 3 (Grigoriev, Hirsch, and Pasechnik [3]). Let a G {0,1}" and b G {0,1}, and let 
I = supp(a). For every T F I such that |T| = 1 — 6 mod 2, the equation M|,(x) = 0 has a 
tree-like proof from S{a, b) of length linear in |/|, and degree at most \I\. 

Proof. Let t = \T\ and assume without loss of generality that T = {1,... ,t} and I \ T = 
{t -|- 1,..., s}. First multiply + X]i=i+i ^i — 1 by xi. Then use xi — xf = 0 

to get rid of the term (1 — xi) ■ xi on the left-hand side. Repeat for X 2 ,...,Xt to get 

From here, hrst multiply by 1—Xt+i and then use x^+i—x^_,_;^ = 
0 to get rid of (1 — Xt+i )' ^t+i ■ nj=i(l “ ^ 3 ) left-hand side. Repeat for Xt+ 2 ,..., x^ to 

get 0 > n 5 =i ■ nj=t+i(l “ ^j)- The converse inequality has a direct proof not even using 
any of the axioms in iS(a, b). □ 

The last lemma we need also refers to extended monomials: 

Lemma 4. Let T C / C [n]. Then the equation {Y2i^jXi — |T|) • Mf = 0 has a tree-like 
proof of length linear in |/|, and degree at most |/| -|- 1 . 
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Proof. Write M for Mf. For every i G I \T, using Xi ■ {1 — xf) = Xi — xf = 0 we get 
Xi ■ M = 0. For every i E T, using x‘^ — Xi = 0 we get Xi ■ M = M. Adding up we get 
J:^^,x.-M=\T\-M. □ 


Theorem 1. Let A G {0,1}”^^"' o,nd b G {0,1}™- //Ax = b is unsatisfiable in F 2 , then 
S{A, b) has a (not necessarily tree-like) refutation of size polynomial in n and 2^, and degree 
linear in w, where w is the maximum number of non-zero components in any of the rows of 

A. 

Proof. Let ai,...,am be the rows of A, with a^ = (a^^,..., Assume Ax = b is 

unsatisfiable in F 2 . Then the F 2 -rank of the matrix [A | b] is bigger than the rank of A. 
This means that there exists a subset of rows J such that |J| < n and — 0 

Yljejbj = 1 with arithmetic in F 2 . In order to simplify notation, we assume without loss of 
generality that J = {1,..., | J|}. 

For every k E {0,..., | J|}, let 


/ k n \ 

•= 2 • 

\yj=i i=i j=fc+i y 

We provide proofs of Dc{Lk{x.)) > 0 for every c G Rk ■= {0,..., (A: + 1) • n} by reverse 
induction on A: G {0,..., | J|}. 

The base case A: = | J| is a special case of Lemma [1] To see why note that the condition 
~ 0 means that if arithmetic is in Q then ^j,i even natural number for 
every i E [n]. But then all the coefficients of 



are integers. Hence Lemma [T] applies. 

Suppose now that 0 < A: < | J| — 1 and that we have a proof of Dfi{Lk+i(x)) > 0 available 
for every d E Rk+i- Fix c G Rk', our immediate goal is to give a proof of Dc{Lk(x)) > 0. As 
k is fixed, write L(x) instead of Lfc_|_i(x), and let the equation = bk+i be written as 

where / = supp(a). Note that L(x) = Lfc(x) + iT(x) where f'(x) := —b+'^-^jXi. 
Fix TCI such that |T| = b mod 2, and let d = c + where t = |T|. Note that d E Rk+i as 
c E Rk and 0 < f < n and 0 < 6 < 1 are such that t — b is even. Multiplying Dd{L(x)) > 0 
by ALf (x) we get 

(L(x) — d) ■ (L(x) — d + 1 ) ■ M|.(x) > 0 . (2) 

Replacing L(x) = Lfc(x) + | • £(x) in the factor (L(x) — d) and recalling d = c + this 
inequality can be written as 

{Lk{x) - c) ■ (L(x) - d + 1) • M|,(x) + (L(x) - d + 1) ■ | ■ A(x) > 0 (3) 
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where ^(x) := (^(x) + b — t) ■ M|,(x). By Lemma 0] we have a proof of ^(x) = 0, and hence 
of (-L(x) — d + 1) ■ I ■ v4(x) = 0. Composing with ([2]) we get a proof of 

(Lfc(x) - c) • (L(x) - d+1) ■ Mf(x) > 0. (4) 

The same argument applied to the factor (L(x) — d + 1) of this inequality gives 

(Lfc(x) - c) ■ (La.(x) - c + 1) • Mf (x) > 0. (5) 

This is precisely Dc{Lk{-s)) ■ (x) > 0. Adding up over all T C / with \T\ = h mod 2 we 

get 

D,(Lfc(x)) ■ M^(x) > 0 . ( 6 ) 

TCI 

\T\=b 

By Lemma [21 from the inequalities for = b we get proofs of Mf(x) = 0 for every 

TCI such that |r| = 1 — 6 mod 2. But then also of Dc{Lk{x)) ■ Mf (x) = 0 for every such 
T. Adding up and composing with ([ 6 ]) we get 

D,(Lfc(x))- 5 ^M^(x) >0 
TCI 

which is precisely Dc{Lk{yI)) > 0 because '^tci 1 by ([I]). 

At this point we proved Dc(Lo(x)) > 0 for every c G i?o = {0,... ,n}. Recall now that 
bj is odd, say 2g + l, and at most n. In particular q + 1 belongs to Rq and -Lo(x) = q + ^- 
Thus we have a proof of £)g+i(Lo(x)) > 0 where Zi)g+i(Lo(x)) = ^ Multiplying 

by 4 we get —1 > 0. □ 

4 Prime fields 

Let p be a prime. We identify the elements of the held with p elements Fp with the integers 
{0,... ,p — 1}. For every z G [n], let Xj = (xj(0),..., Xi{p — 1)) be formal variables ranging 
over Q, and let x = (xi,..., x„). By imposing the constraints 

3 ^*( 0 ) + ■ • • + Xj(p — 1) = 1 for all i G [n] 

Xi{j) — Xi{jY = 0 for all i G [n] and j G {0,... ,p — 1} 

each Xj is the indicator vector of some value in Fp. Consequently we think of Xj as a formal 
variable ranging over Fp. In the following, let Z be the set of equations Xj(0) + - • •+Xj(p—1) = 
1 as z ranges over [n]. 

For every linear equation of the type a'^x = b where a = (oi,..., an) G F” and b G Fp, 
let iS(a, b) be the system of linear inequalities 

(1 — Xi{zi)) > 1 for all z G Fp such that Xlie/ ^ ^ p 
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where I = supp(a) := {i E [n] : ai 7 ^ 0}. Observe that these are at most different in¬ 
equalities. For a system Ax = b of m linear equations as above, let iS(A, b) := IJ^i ‘^(^0 ^i) 
as aj ranges over the rows of A and bi ranges over the components of b. 

In the following, for / C [n] and z E F^, let 


^z(x) := Yl 


i£l 


( p -1 \ 

fcO: 

\ / 


We start with the analogue of ([T]). This time we need to assume some axioms. 

Lemma 5. Let I C [n]. The equation XlzgF-f ^z(^) ~ ^ ® tree-like proof from Z of 

length polynomial in \I\ and p, and degree linear in \I\p. 

Proof. Using X]?=o ^ Xi{zi) — Xi{ziY = 0 we have 


p-i 


/ 


p-i 


\ 


1 ==Yl =Y n ^**^^*) ■ 


ig/ 1=0 


zgFfc i&I 


zgF^ ig/ 


zgFfc i&I 


1 = 0 -. 




Lemma [2] to get an actual proof. □ 

Lemma 6 . Let a G F” and b E Fp. For every z G F^ such that ^ ^ mod p, 

where I = supp(a), the equation Mz(x) = 0 has a tree-like proof from S{a,b) U Z of length 
polynomial in |/| andp, and degree at most \I\p. 

Proof. Without loss of generality, assume / = {!,..., A:}. Start at ~ ^i{p)) ^ 1 

from iS(a, 6 ), multiply by Xi{zi), and use Xi{zi) ■ (1 — Xi{zi)) = Xi{zi) — Xi{ziY = 0 to get 
Zli= 2 (l “ > xi{zi). Repeat with X 2 (^ 2 ), • • -.Xkizk) to get 0 > ]\\^iXi{zi). Multiply 

by (1 — Xj(£)) for every i E I and I E {0,... ,p — 1} \ {zi} to get 0 > M^ipP). The reverse 
inequality has a direct proof not even using any of the axioms from iS(a, h)VJ Z. □ 

The following is the analogue of Lemma |H 

Lemma 7. Let / C [n], a G F^, and z G F^. Then the equation 


, i&I 


p-l 

Oi'^iXii 

1=0 


i£l 


CLiZi 


Mz 


= 0 


has a tree-like proof of length polynomial in \I\ and p, and degree at most |/|p + 1. 

Proof. Write M for M^ipP). For every i E I and every i G {0,...,p — 1} \ {zi}, using 
Xi{i) ■ (1 — Xi{£)) = Xi{£) — Xi{£Y = 0 we get aiixi{i) ■ M = 0. For every i E I, using 
Xi{zi)‘^ — Xi{zi) = 0 we get aiZiXi{zi) ■ M = aiZi ■ M. Adding up we get what we want. □ 
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Theorem 2. Let A G and b G F™. //Ax = b is unsatisfiable in Fp, then iS(A, h)UZ 
has a (not necessarily tree-like) refutation of size polynomial in n and p'^, and degree linear 
in w, where w is the maximum number of non-zero components of the rows of A. 

Proof. Let ai,..., a^, G F^ be the rows of A. Assume Ax = b is unsatisfiable in Fp. Then 
the Fp-rank of the matrix [A | b] is bigger than the rank of A, which means that there exists 
a subset of rows J C [m] and a vector of multipliers y = (yj : / G J) G Fp such that | J| < n 
and = 0 ^ with arithmetic in Fp. In order to simplify notation, 

we assume without loss of generality that J = {1,..., | J|}. 

For every / G {0,..., | J|}, let 

^ / fc n iJ| \ 

•= ~ yt^t ’ 

\j=l *=1 j=k+l j 

where Xi := X]?=o ^ We provide proofs of Dc{Lk(x)) > 0 for every c E Rk '■= 

{0,...,(/ + l)p^n} by reverse induction on /c G {0,..., | J|}. 

The base case k = \J\ is a special case of Lemma [H To see why note that the condition 
'Yhj&jyj^i ~ 0 means that if arithmetic is in Q then integer multiple of p 

for every i E [n]. But then all the coefficients of 

^ |J| n n p -1 \ 

^ 1^1 = -J2 y^Ylyt^p 

y j=i i=i i=i £=o yy j=i j 

are integers. Hence Lemma [T] applies. 

Suppose now that 0 < A: < | J| — 1 and that we have a proof of Dd{Lk+i(x.)) > 0 available 
for every d G Rk+i- Fix c G Rk] our immediate goal is to give a proof of Dc{Lk(x)) > 0. As 
k is hxed, write L(x) instead of Lfc+i(x), and also y instead of yk+ii and let the equation 
= hk+i be written as aiXi = 6, where / = supp(a). Note that L(x) = Lfc(x) + | • 
/(x) where /(x) := -b + OiXi. 

Split Fp into Z := {z G Fp : ^ p} and Z := Fp \ Z. Fix z E Z and let 

t := ttiZi with arithmetic in Q. Let d = c + and note that d E Rk+i as c G /?fc, 

0 < t < 0 < p < p — 1 , and 0 < 6 < p — 1 are such that t — / is an integer multiple of 

p. Multiplying Dd{L(x)) > 0 by Mz(x) we get 

(L(x) - d) ■ (L(x) - d + 1) ■ Mz(x) > 0. (7) 

Replacing L(x) = Lk(A) + | • /(x) in the factor (L(x) — d) and recalling d = c + this 

inequality can be written as 

(Lfc(x) - c) • (L(x) - d + 1 ) ■ Mz(x) + (L(x) - d + 1 ) • | • A(x) > 0 ( 8 ) 

where A(x) := (/(x) + h — t) ■ Mz(x). By Lemma [7] we have a proof of A(x) = 0, and hence 

of (L(x) — d + 1) • I • A(x) = 0. Composing with ([H]) we get a proof of 

(Lfc(x) - c) • (L(x) - d + 1) • Mz(x) > 0. (9) 


7 




The same argument applied to the factor (L(x) — d -h 1) of this inequality gives 

(Lfc(x) - c) • (Lfc(x) - c + 1) • Mz(x) > 0. (10) 

This is precisely Dc(Lk(x)) ■ M^ix) > 0. Adding over Z we get 

D,(Lfc(x))-5^M,(x) >0. (11) 

By Lemma [6l from the inequalities in S{sik+i,bk+i) we get proofs of M^ix) = 0 for every 
z G Z. But then also Dc{Lk(x)) ■ M^ix) = 0 for every such z. Adding up and composing 
with ffTTl) we get 

D,{Lk{x)) ■ Y, > 0 

x&zvSz 

which is precisely Dc{Lk{x)) > 0 because Afz(x) = 1 by Lemma [5l 

At this point we proved Dc{Lq{x)) > 0 for every c G -Rq = {0, • • • ,p^n}. Recall now 
that Vj^j is congruent to 1 mod p, say pq + 1, and smaller than p'^n. In particular 

q + 1 belongs to Rq and Lq{x) = q + ^. Thus we have a proof of Zlg+i(Lo(x)) > 0 where 
Zl,+i(Lo(x)) = (1 - 1) . 1 = ^. Multiplying by ^ > 0 we get -1 > 0. □ 

5 Closing remarks 

The upper bound in Theorem [1] is to be put in contrast with the lower bounds proved by 
Grigoriev j2] as rediscovered by Schoenebeck [^. Those lower bounds hold for static semi- 
algebraic proofs, and even static sums-of-squares (SOS) proofs. In short, the static version of 
semi-algebraic proofs can be formulated as the restriction to proofs in which all applications 
of the multiplication rules must precede all applications of the positive linear combination 
rule. Static sums-of-squares proofs would be the same with the addition of axioms of the form 
YlT=i — 0 arbitrary polynomials Pi,..., Pm- See [1] and subsequent work for some 

recent exciting applications of static sums-of-squares proofs to combinatorial optimization. 

The above-mentioned lower bounds show that there exist explicit systems of linear equa¬ 
tions Ax = b with n variables and three variables per equation, that are unsatishable over 
the two-element held but for which any static semi-algebraic or sums-of-squares refutation 
must have degree Q{n). This holds with respect to the same representation of linear systems 
that we use here. It can also be seen that their proof also yields an exponential lower 
bound in size and length. More strongly, from the size-degree trade-off results in [5] for 
tree-like proofs, such lower bounds on degree and size apply also to the tree-like restrictions 
of semi-algebraic proofs and sums-of-squares proofs. We note that static proofs may be 
assumed tree-like without any signihcant loss in degree, size or length, so this is a strength¬ 
ening. Theorem [T] shows that such lower bounds do not extend to general, i.e. dag-like, 
semi-algebraic proofs. 
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